基于图形卷积网络的方法对车身连接关系进行建模，最近在基于3D骨架的人体运动预测中显示出巨大的希望。但是，这些方法有两个关键问题：首先，仅在有限的图形频谱中过滤特征，在整个频段中丢失了足够的信息；其次，使用单个图对整个身体进行建模，低估了各个身体部门的各种模式。为了解决第一个问题，我们提出了自适应图散射，该散射利用了多个可训练的带通滤波器将姿势特征分解为较丰富的图形频谱频段。为了解决第二个问题，分别对身体零件进行建模以学习多种动力学，从而沿空间维度提取更精细的特征提取。整合了上述两种设计，我们提出了一个新型的骨架派对图散射网络（SPGSN）。该模型的核心是级联的多部分图形散射块（MPGSB），在不同的身体部门建立自适应图散射，并基于推断的频谱重要性和身体零件相互作用融合分解的特征。广泛的实验表明，SPGSN的表现优于最先进的方法，其优于13.8％，9.3％和2.7％的SPGSN在每个联合位置误差（MPJPE）上，在36m，CMU MOCAP和3DPW Dataset，3D平均位置误差（MPJPE）方面，SPGSN优于最先进的方法。分别。

我们提出了一个无监督的卷积神经网络（CNN），用于放松参数估计。该网络包含信号松弛和Bloch模拟，同时利用邻近voxels的剩余学习和空间关系。与数值模拟中的标准参数估计方法和多回波T2和T2 *映射的标准参数估计方法相比，显示了对噪声的量化精度和稳健性。所提出的网络与子空间建模的组合和来自高度提高数据的子空间建模和MR指纹识别（MRF）允许高质量的T1和T2映射。

最新的工业推理引擎（例如FASTRASTRANSFORMER1和TURBOTTRANSFORMER）已验证了半精度的浮点（FP16）和8位整数（INT8）量化可以极大地提高模型推断速度。但是，现有的FP16或INT8量化方法太复杂了，使用不当将大大导致性能损害。在本文中，我们开发了一个工具包，供用户轻松量化其模型以进行推理，其中提出了自适应混合精液（SAMP），以通过混合精确体系结构自动控制量化率，以平衡效率和性能。实验结果表明，我们的SAMP工具包比Pytorch和Fertransformer具有更高的速度，同时确保了所需的性能。此外，SAMP基于模块化设计，将令牌，嵌入，编码器和目标层解耦，该层允许用户处理各种下游任务，并且可以将其无缝集成到Pytorch中。

学习神经集功能在许多应用中越来越重要，例如产品推荐和AI辅助药物发现中的复合选择。在功能值Oracle下，大多数现有的作品研究方法学方法学方法学都需要昂贵的监督信号。这使得仅在最佳子集（OS）Oracle下仅进行弱监督的应用程序使其不切实际，而研究的研究令人惊讶地忽略了。在这项工作中，我们提出了一个原则上但实用的最大似然学习框架，称为等效性，该框架同时满足OS ORACLE下的以下学习设置功能：i）置入了模型的设定质量函数的置换率； ii）许可不同地面套件； iii）最低先验；和iv）可伸缩性。我们框架的主要组成部分涉及：对设定质量函数的基于能量的处理，深空式体系结构来处理置换不变性，平均场变异推理及其摊销变体。由于这些高级体系结构的优雅组合，对三个现实世界应用的实证研究（包括亚马逊产品推荐，设置异常检测和虚拟筛选的复合选择）表明，EquivSet的表现优于基本线的大幅度。

蛋白质 - 蛋白质相互作用（PPI）对于许多生物过程至关重要，其中两种或更多种蛋白质物理地结合在一起以实现其功能。建模PPI对许多生物医学应用有用，例如疫苗设计，抗体治疗和肽药物发现。预先训练蛋白质模型以学习有效的代表对于PPI至关重要。对于PPI的大多数预训练模型是基于序列的，这是基于序列的，该模型是基于氨基酸序列的自然语言处理中使用的语言模型。更先进的作品利用结构感知的预训练技术，利用已知蛋白质结构的联系地图。然而，既不是序列和联系地图都可以完全表征蛋白质的结构和功能，这与PPI问题密切相关。灵感来自这种洞察力，我们提出了一种具有三种方式的多模式蛋白质预训练模型：序列，结构和功能（S2F）。值得注意的是，而不是使用联系地图来学习氨基酸水平刚性结构，而是用重度原子的点云的拓扑复合物编码结构特征。它允许我们的模型不仅仅是基于底部的结构信息，还可以了解侧链。此外，我们的模型包括从文献或手动注释中提取的蛋白质的功能描述中的知识。我们的实验表明，S2F学习蛋白质嵌入物，在包括各种PPI，包括跨物种PPI，抗体 - 抗原亲和预测，抗体中和对SARS-COV-2的抗体中和预测的蛋白质嵌入，以及突变驱动的结合亲和力变化预测。

机器学习在虚拟筛选中显示出巨大的潜力，用于药物发现。目前正在加速基于对接的虚拟筛选的努力不考虑使用其他先前开发的目标的现有数据。为了利用其他目标的知识并利用现有数据，在这项工作中，我们将多任务学习应用于基于对接的虚拟筛选问题。通过两个大型对接数据集，广泛实验结果表明，多任务学习可以实现对接分数预测的更好性能。通过在多个目标上学习知识，由多任务学习训练的模型显示了适应新目标的更好能力。额外的实证研究表明，药物发现中的其他问题，例如实验药物 - 目标亲和预测，也可能受益于多任务学习。我们的结果表明，多任务学习是基于对接的虚拟筛选和加速药物发现过程的有前途的机器学习方法。

Masked image modeling (MIM) performs strongly in pre-training large vision Transformers (ViTs). However, small models that are critical for real-world applications cannot or only marginally benefit from this pre-training approach. In this paper, we explore distillation techniques to transfer the success of large MIM-based pre-trained models to smaller ones. We systematically study different options in the distillation framework, including distilling targets, losses, input, network regularization, sequential distillation, etc, revealing that: 1) Distilling token relations is more effective than CLS token- and feature-based distillation; 2) An intermediate layer of the teacher network as target perform better than that using the last layer when the depth of the student mismatches that of the teacher; 3) Weak regularization is preferred; etc. With these findings, we achieve significant fine-tuning accuracy improvements over the scratch MIM pre-training on ImageNet-1K classification, using all the ViT-Tiny, ViT-Small, and ViT-base models, with +4.2%/+2.4%/+1.4% gains, respectively. Our TinyMIM model of base size achieves 52.2 mIoU in AE20K semantic segmentation, which is +4.1 higher than the MAE baseline. Our TinyMIM model of tiny size achieves 79.6% top-1 accuracy on ImageNet-1K image classification, which sets a new record for small vision models of the same size and computation budget. This strong performance suggests an alternative way for developing small vision Transformer models, that is, by exploring better training methods rather than introducing inductive biases into architectures as in most previous works. Code is available at https://github.com/OliverRensu/TinyMIM.

In this paper, we propose a robust 3D detector, named Cross Modal Transformer (CMT), for end-to-end 3D multi-modal detection. Without explicit view transformation, CMT takes the image and point clouds tokens as inputs and directly outputs accurate 3D bounding boxes. The spatial alignment of multi-modal tokens is performed implicitly, by encoding the 3D points into multi-modal features. The core design of CMT is quite simple while its performance is impressive. CMT obtains 73.0% NDS on nuScenes benchmark. Moreover, CMT has a strong robustness even if the LiDAR is missing. Code will be released at https://github.com/junjie18/CMT.

Dataset distillation has emerged as a prominent technique to improve data efficiency when training machine learning models. It encapsulates the knowledge from a large dataset into a smaller synthetic dataset. A model trained on this smaller distilled dataset can attain comparable performance to a model trained on the original training dataset. However, the existing dataset distillation techniques mainly aim at achieving the best trade-off between resource usage efficiency and model utility. The security risks stemming from them have not been explored. This study performs the first backdoor attack against the models trained on the data distilled by dataset distillation models in the image domain. Concretely, we inject triggers into the synthetic data during the distillation procedure rather than during the model training stage, where all previous attacks are performed. We propose two types of backdoor attacks, namely NAIVEATTACK and DOORPING. NAIVEATTACK simply adds triggers to the raw data at the initial distillation phase, while DOORPING iteratively updates the triggers during the entire distillation procedure. We conduct extensive evaluations on multiple datasets, architectures, and dataset distillation techniques. Empirical evaluation shows that NAIVEATTACK achieves decent attack success rate (ASR) scores in some cases, while DOORPING reaches higher ASR scores (close to 1.0) in all cases. Furthermore, we conduct a comprehensive ablation study to analyze the factors that may affect the attack performance. Finally, we evaluate multiple defense mechanisms against our backdoor attacks and show that our attacks can practically circumvent these defense mechanisms.

Blind image quality assessment (BIQA) remains challenging due to the diversity of distortion and image content variation, which complicate the distortion patterns crossing different scales and aggravate the difficulty of the regression problem for BIQA. However, existing BIQA methods often fail to consider multi-scale distortion patterns and image content, and little research has been done on learning strategies to make the regression model produce better performance. In this paper, we propose a simple yet effective Progressive Multi-Task Image Quality Assessment (PMT-IQA) model, which contains a multi-scale feature extraction module (MS) and a progressive multi-task learning module (PMT), to help the model learn complex distortion patterns and better optimize the regression issue to align with the law of human learning process from easy to hard. To verify the effectiveness of the proposed PMT-IQA model, we conduct experiments on four widely used public datasets, and the experimental results indicate that the performance of PMT-IQA is superior to the comparison approaches, and both MS and PMT modules improve the model's performance.